Overriding multimedia device

ABSTRACT

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for switching the output of an overriding multimedia device from a first input to a second input or a combination of the first input and the second input. An example embodiment operates by receiving sensor data detected by a sensing device and relating to a multimedia switching event. The example embodiment further operates by determining that sensor data detected by a sensing device corresponds to a multimedia switching action. In response, the example embodiment operates by generating a multimedia switching actuation signal that instructs an overriding multimedia device to switch its output from the first multimedia signal to the second multimedia signal. Subsequently, the example embodiment operates by transmitting the multimedia switching actuation signal to the overriding multimedia device.

BACKGROUND Field

This disclosure is generally directed to multimedia switching, and moreparticularly to High-Definition Multimedia Interface (HDMI) switching.

Background

Content, such as a movie or television (TV) show, is typically displayedon a TV or other display screen for watching by users. Some TVs includeintegrated applications and inputs configured to receive and transmitmultimedia (e.g., audio and video) signals from and to thoseapplications and connected devices. In one example, an application orconnected device can receive telephone calls. However, when such callsare received, managing input switching from the content that the user iswatching to the incoming telephone call (e.g., through HDMI's ConsumerElectronics Control (CEC) protocol) can be slow and problematic.Accordingly, to date, efforts to extend a user's experience to includereceiving and making calls while watching content on the TV have beenlimited.

SUMMARY

Provided herein are system, apparatus, article of manufacture, methodand/or computer program product embodiments, and/or combinations andsub-combinations thereof, for switching the output of an overridingmultimedia device from a first input to a second input or a combinationof the first input and the second input in response to, for example, avideoconference call or alert being received by a device connected tothe second input. In one example, the disclosed embodiments provide forvideo calling when interacting with multiple devices connected to a TVvia the HDMI protocol. In another example, the disclosed embodimentsprovide for displaying emergency alerts when interacting with multipledevices connected to a TV via the HDMI protocol.

An example embodiment includes an apparatus including a first multimediainput connector configured to connect to a first media device andreceive a first multimedia signal from the first media device. Theapparatus further includes a second multimedia input connectorconfigured to connect to a second media device and receive a secondmultimedia signal from the second media device. The apparatus furtherincludes a multimedia output connector configured to connect to adisplay device and transmit the first multimedia signal, the secondmultimedia signal, or a combination of the first multimedia signal andthe second multimedia signal to the display device. The apparatusfurther includes an overriding multimedia device electrically coupled tothe first multimedia input connector, the second multimedia inputconnector, and the multimedia output connector. The overridingmultimedia device is configured to generate, at a first time, a firstconductive electrical path between the first multimedia input connectorand the multimedia output connector. The overriding multimedia device isfurther configured to receive a multimedia switching actuation signal.In response to a receipt of the multimedia switching actuation signal,the overriding multimedia device is configured to generate, at a secondtime later than the first time, a second conductive electrical pathbetween the second multimedia input connector and the multimedia outputconnector.

Another example embodiment includes an apparatus including a memoryconfigured to store priority multimedia input data that includes a firstpriority value for a first multimedia signal and a second priority valuefor a second multimedia signal. The apparatus further includes at leastone processor coupled to the memory and configured to receive sensordata detected by a sensing device and relating to a multimedia switchingevent. The at least one processor is further configured to determinethat the sensor data corresponds to a multimedia switching action basedon a first determination that the sensor data has caused the secondpriority value to increase above the first priority value. In responseto a second determination that the sensor data corresponds to themultimedia switching action, the at least one processor is furtherconfigured to generate a multimedia switching actuation signalconfigured to instruct an overriding multimedia device to switch anoutput of the overriding multimedia device from the first multimediasignal to the second multimedia signal. The at least one processor isfurther configured to transmit the multimedia switching actuation signalto the overriding multimedia device. In at least one embodiment, sensordata can include audio data, video data, input data (e.g., user inputvia remote control, motion data, emergency alert data, phone call),and/or environmental data (e.g., proximity detection, fire detector,assistant device data such as an alarm or timer).

Another example embodiment includes a non-transitory computer-readablemedium having instructions stored thereon that, when executed by atleast one computing device, cause the at least one computing device toperform operations that include receiving sensor data detected by asensing device and relating to a multimedia switching event. Theoperations further include determining that the sensor data correspondsto a multimedia switching action by determining that the sensor data hascaused a first priority value for a first multimedia signal to decreasebelow a second priority value for a second multimedia signal. Inresponse to the determining that the sensor data corresponds to themultimedia switching action, the operations further include generating amultimedia switching actuation signal that instructs an overridingmultimedia device to switch an output of the overriding multimediadevice from the first multimedia signal to the second multimedia signal.The operations further include transmitting the multimedia switchingactuation signal to the overriding multimedia device.

Another example embodiment includes a computer-implemented method thatoperates by receiving, by at least one processor, sensor data detectedby a sensing device and relating to a multimedia switching event. Thecomputer-implemented method further operates by determining, by the atleast one processor, that the sensor data corresponds to a multimediaswitching action by determining that the sensor data has caused a firstpriority value for a first multimedia signal to decrease below a secondpriority value for a second multimedia signal. In response to thedetermining that the sensor data corresponds to the multimedia switchingaction, the computer-implemented method further operates by generating,by the at least one processor, a multimedia switching actuation signalthat instructs an overriding multimedia device to switch an output ofthe overriding multimedia device from the first multimedia signal to thesecond multimedia signal. The computer-implemented method furtheroperates by transmitting, by the at least one processor, the multimediaswitching actuation signal to the overriding multimedia device.

BRIEF DESCRIPTION OF THE FIGURES

The accompanying drawings are incorporated herein and form a part of thespecification.

FIG. 1 illustrates a block diagram of a multimedia environment,according to some embodiments.

FIG. 2 illustrates a block diagram of a streaming media device,according to some embodiments.

FIG. 3 is a block diagram of an overriding multimedia system, accordingto some embodiments.

FIG. 4 is a block diagram of another overriding multimedia system,according to some embodiments.

FIG. 5 is a flowchart illustrating a process for multimedia switching,according to some embodiments.

FIG. 6 illustrates an example computer system useful for implementingvarious embodiments.

In the drawings, like reference numbers generally indicate identical orsimilar elements. Additionally, generally, the left-most digit(s) of areference number identifies the drawing in which the reference numberfirst appears.

DETAILED DESCRIPTION

Provided herein are system, apparatus, device, method and/or computerprogram product embodiments, and/or combinations and sub-combinationsthereof, for switching the output of an overriding multimedia devicefrom a first input to a second input or a combination of the first inputand the second input in response to, for example, a videoconference callor alert being received by a device connected to the second input.

Various embodiments of this disclosure may be implemented using and/ormay be part of a multimedia environment 102 shown in FIG. 1 , in someembodiments. It is noted, however, that multimedia environment 102 isprovided solely for illustrative purposes, and is not limiting.Embodiments of this disclosure may be implemented using and/or may bepart of environments different from and/or in addition to the multimediaenvironment 102, as will be appreciated by persons skilled in therelevant art(s) based on the teachings contained herein. An example ofthe multimedia environment 102 shall now be described.

Multimedia Environment

FIG. 1 illustrates a block diagram of a multimedia environment 102,according to some embodiments. In a non-limiting example, multimediaenvironment 102 may be directed to streaming media. However, thisdisclosure is applicable to any type of media (instead of or in additionto streaming media), as well as any mechanism, means, protocol, methodand/or process for distributing media.

The multimedia environment 102 may include one or more media systems104. A media system 104 could represent a family room, a kitchen, abackyard, a home theater, a school classroom, a library, a car, a boat,a bus, a plane, a movie theater, a stadium, an auditorium, a park, abar, a restaurant, or any other location or space where it is desired toreceive and play streaming content. User(s) 132 may operate with themedia system 104 to select and consume content.

Each media system 104 may include one or more media devices 106 eachcoupled to one or more display devices 108 via an overriding multimediasystem 107. It is noted that terms such as “coupled,” “connected to,”“attached,” “linked,” “combined” and similar terms may refer tophysical, electrical, magnetic, logical, etc., connections, unlessotherwise specified herein.

Media device 106 may be a streaming media device, DVD or BLU-RAY device,audio/video playback device, cable box, and/or digital video recordingdevice, to name just a few examples. Display device 108 may be amonitor, television (TV), computer, smart phone, tablet, wearable (suchas a watch or glasses), appliance, internet of things (IoT) device,and/or projector, to name just a few examples. In some embodiments,media device 106 can be a part of, integrated with, operatively coupledto, and/or connected to its respective display device 108 via overridingmultimedia system 107. For example, in some embodiments, the overridingmultimedia system 107 may be integrated into the display device 108.

Each media device 106 may be configured to communicate with network 118via a communications device 114. The communications device 114 mayinclude, for example, a cable modem or satellite TV transceiver. Themedia device 106 may communicate with the communications device 114 overa link 116, wherein the link 116 may include wireless (such as WiFi)and/or wired connections.

In various embodiments, the network 118 can include, without limitation,wired and/or wireless intranet, extranet, Internet, cellular, Bluetooth,infrared, and/or any other short range, long range, local, regional,global communications mechanism, means, approach, protocol and/ornetwork, as well as any combination(s) thereof.

Media system 104 may include a remote control 110. The remote control110 can be any component, part, apparatus and/or method for controllingthe media device 106, overriding multimedia system 107, and/or displaydevice 108, such as a remote control, a tablet, laptop computer,smartphone, wearable, on-screen controls, integrated control buttons,audio controls, or any combination thereof, to name just a few examples.In an embodiment, the remote control 110 wirelessly communicates withthe media device 106, overriding multimedia system 107, and/or displaydevice 108 using cellular, Bluetooth, infrared, etc., or any combinationthereof. The remote control 110 may include a microphone 112, which isfurther described below.

The multimedia environment 102 may include a plurality of contentservers 120 (also called content providers or sources). Although onlyone content server 120 is shown in FIG. 1 , in practice the multimediaenvironment 102 may include any number of content servers 120. Eachcontent server 120 may be configured to communicate with network 118.

Each content server 120 may store content 122 and metadata 124. Content122 may include any combination of music, videos, movies, TV programs,multimedia, images, still pictures, text, graphics, gaming applications,advertisements, programming content, public service content, governmentcontent, local community content, software, and/or any other content ordata objects in electronic form.

In some embodiments, metadata 124 comprises data about content 122. Forexample, metadata 124 may include associated or ancillary informationindicating or related to writer, director, producer, composer, artist,actor, summary, chapters, production, history, year, trailers, alternateversions, related content, applications, and/or any other informationpertaining or relating to the content 122. Metadata 124 may also oralternatively include links to any such information pertaining orrelating to the content 122. Metadata 124 may also or alternativelyinclude one or more indexes of content 122, such as but not limited to atrick mode index.

The multimedia environment 102 may include one or more system servers126. The system servers 126 may operate to support the media devices 106from the cloud. It is noted that the structural and functional aspectsof the system servers 126 may wholly or partially exist in the same ordifferent ones of the system servers 126.

The media devices 106 may exist in thousands or millions of mediasystems 104. Accordingly, the media devices 106 may lend themselves tocrowdsourcing embodiments and, thus, the system servers 126 may includeone or more crowdsource servers 128.

For example, using information received from the media devices 106 inthe thousands and millions of media systems 104, the crowdsourceserver(s) 128 may identify similarities and overlaps between closedcaptioning requests issued by different users 132 watching a particularmovie. Based on such information, the crowdsource server(s) 128 maydetermine that turning closed captioning on may enhance users' viewingexperience at particular portions of the movie (for example, when thesoundtrack of the movie is difficult to hear), and turning closedcaptioning off may enhance users' viewing experience at other portionsof the movie (for example, when displaying closed captioning obstructscritical visual aspects of the movie). Accordingly, the crowdsourceserver(s) 128 may operate to cause closed captioning to be automaticallyturned on and/or off during future streamings of the movie.

The system servers 126 may also include an audio command processingmodule 130. As noted above, the remote control 110 may include amicrophone 112. The microphone 112 may receive audio data from users 132(as well as other sources, such as the display device 108). In someembodiments, the media device 106 may be audio responsive, and the audiodata may represent verbal commands from the user 132 to control themedia device 106 as well as other components in the media system 104,such as the display device 108.

In some embodiments, the audio data received by the microphone 112 inthe remote control 110 is transferred to the media device 106, which isthen forwarded to the audio command processing module 130 in the systemservers 126. The audio command processing module 130 may operate toprocess and analyze the received audio data to recognize the user 132'sverbal command. The audio command processing module 130 may then forwardthe verbal command back to the media device 106 for processing.

In some embodiments, the audio data may be alternatively or additionallyprocessed and analyzed by an audio command processing module 216 in themedia device 106 (see FIG. 2 ). The media device 106 and the systemservers 126 may then cooperate to pick one of the verbal commands toprocess (either the verbal command recognized by the audio commandprocessing module 130 in the system servers 126, or the verbal commandrecognized by the audio command processing module 216 in the mediadevice 106).

FIG. 2 illustrates a block diagram of an example media device 106,according to some embodiments. Media device 106 may include a streamingmodule 202, processing module 204, storage/buffers 208, and userinterface module 206. As described above, the user interface module 206may include the audio command processing module 216.

The media device 106 may also include one or more audio decoders 212 andone or more video decoders 214. Each audio decoder 212 may be configuredto decode audio of one or more audio formats, such as but not limited toAAC, HE-AAC, AC3 (Dolby Digital), EAC3 (Dolby Digital Plus), WMA, WAV,PCM, MP3, OGG GSM, FLAC, AU, AIFF, and/or VOX, to name just someexamples. Similarly, each video decoder 214 may be configured to decodevideo of one or more video formats, such as but not limited to MP4 (mp4,m4a, m4v, f4v, f4a, m4b, m4r, f4b, mov), 3GP (3gp, 3gp2, 3g2, 3gpp,3gpp2), OGG (ogg, oga, ogv, ogx), WMV (wmv, wma, asf), WEBM, FLV, AVI,QuickTime, HDV, MXF (OP1a, OP-Atom), MPEG-TS, MPEG-2 PS, MPEG-2 TS, WAV,Broadcast WAV, LXF, GXF, and/or VOB, to name just some examples. Eachvideo decoder 214 may include one or more video codecs, such as but notlimited to H.263, H.264, HEV, MPEG1, MPEG2, MPEG-TS, MPEG-4, Theora,3GP, DV, DVCPRO, DVCPRO, DVCProHD, IMX, XDCAM HD, XDCAM HD422, and/orXDCAM EX, to name just some examples.

FIG. 3 illustrates a block diagram of an example overriding multimediasystem 107, according to some embodiments. In at least one embodiment,the overriding multimedia system 107 can be an enhancing multimediasystem. In some embodiments, the overriding multimedia system 107 may beconfigured to perform a hardware override to control its inputs andoutput, bypassing the via electronic protocol (e.g., HDMI CEC protocol)to display high priority information, such as incoming videoconferencecalls, SMS text messages, calendar and event reminders, medicationalerts, and emergency alerts. For example, the overriding multimediasystem 107 can select a priority media signal by taking director controlof the final electronic signal (e.g., HDMI signal) to the display device108. In another example, the overriding multimedia system 107 may beconfigured to bypass or overlay any other sources dynamically.

Overriding multimedia system 107 may include an overriding multimediadevice 302, processing module 304, storage/buffers 308, user interfacemodule 306, and one or more sensing devices 312 (e.g., including, butnot limited to, a microphone and a camera). In some embodiments, theuser interface module 306 may include the audio command processingmodule 316 and may be coupled to the one or more sensing devices 312.

In some embodiments, the one or more sensing devices 312 may include anaudio sensing device (e.g., a microphone) configured to receive audiodata from users 132 (as well as other sources, such as the displaydevice 108). In some embodiments, the overriding multimedia system 107may be audio responsive, and the audio data may represent verbalcommands from the user 132 to control the overriding multimedia system107 as well as other components in the media system 104, such as thedisplay device 108.

In some embodiments, the one or more sensing devices 312 may include avideo sensing device (e.g., a high-definition (HD) camera) configured tocapture video data from users 132 (as well as other sources, such as thedisplay device 108). For example, the overriding multimedia system 107may be configured to provide for video calling using a ten-foot userinterface, an HD camera, and a smart zooming function to provide theuser 132 with an improved videoconferencing experience.

In some embodiments, the audio data received by the microphone 112 inthe remote control 110, or by the one or more sensing devices 312 in theoverriding multimedia system 107, may be transferred to the overridingmultimedia system 107, which is then forwarded to the audio commandprocessing module 316 in the overriding multimedia system 107 forprocessing and analysis. The audio command processing module 316 mayoperate to process and analyze the received audio data to recognize theuser 132's verbal command. The audio command processing module 316 maythen forward the verbal command to another component of the overridingmultimedia system 107 for processing.

Overriding multimedia system 107 may include one or more inputs and oneor more outputs coupled to the overriding multimedia device 302. Forexample, overriding multimedia device 302 may include a plurality ofmultimedia input connectors 322A-322N connected to the overridingmultimedia device 302 and a plurality of respective media devices 106.Overriding multimedia system 107 may further include a multimedia outputconnector 324 connected to the overriding multimedia device 302 and adisplay device 108.

In some embodiments, the processing module 304 may be connected to theoverriding multimedia device 302 directly or, optionally, via anopto-isolator 314. For example, the processing module 304 may generate acontrol signal and transmit the control signal to the opto-isolator 314via a GPIO interface. Opto-isolator 314 may receive the control signal.In some embodiments, a control signal can be transmitted based on thereceived control signal, and transmit the control signal to theoverriding multimedia device 302 via a switch interface. In oneillustrative example, the control signal may be configured to instructthe overriding multimedia device 302 to perform a switching functionthat is substantially similar to the switching function that would havebeen performed had the user 132 actuated a physical switch (e.g.,pressed a physical button) connected to the overriding multimedia device302 to override the multimedia inputs.

FIG. 4 illustrates a block diagram of an example overriding multimediasystem 107′, according to some embodiments. In some embodiments,overriding multimedia system 107′ may be configured to perform ahardware override to control its inputs and output via the physicalelectrical connection to display high priority information, such asincoming videoconference calls, SMS text messages, calendar and eventreminders, and emergency alerts. For example, by selecting a prioritymedia device and placing the selected media device in direct control ofthe final HDMI signal to the display device 108, overriding multimediasystem 107′ may be configured to bypass or overlay any other sourcesdynamically. In some embodiments, override multimedia system 107′ may beconfigured to perform a media data modification operation to displayhigh priority information via a visual overlay, audio overlay, and/orother data stream overlay (e.g., subtitles), such as incomingvideoconference calls, SMS text messages, calendar and event reminders,and emergency alerts. An overlay can include a partial replacement ofcontent, integration of alternative content, and/or system UI.

Overriding multimedia system 107′ may include an overriding multimediadevice 402, processing module 404, storage/buffers 408, user interfacemodule 406, and one or more sensing devices 412 (e.g., including, butnot limited to, a microphone and a camera). In some embodiments, theuser interface module 406 may include the audio command processingmodule 416 and may be coupled to the one or more sensing devices 412.

Overriding multimedia system 107′ may further include avideoconferencing application 432, an alert application 434, and one ormore other applications 436 (e.g., a streaming media application, aphoto album sharing application; a medication reminder, tracking, andordering application; a wellness monitoring application; a home securityapplication; a network monitoring application; a remote device controlapplication; etc.).

The one or more sensing devices 412 may include an audio sensing device(e.g., a microphone) configured to receive audio data from users 132 (aswell as other sources, such as the display device 108). In someembodiments, the overriding multimedia system 107′ may be audioresponsive, and the audio data may represent verbal commands from theuser 132 to control the overriding multimedia system 107′ as well asother components in the media system 104, such as the display device108.

In some embodiments, the one or more sensing devices 412 may include avideo sensing device (e.g., a high-definition (HD) camera) configured tocapture video data from users 132 (as well as other sources, such as thedisplay device 108). For example, the overriding multimedia system 107′may be configured to provide for video calling using a ten-foot userinterface, an HD camera, and a smart zooming function to provide theuser 132 with an improved videoconferencing experience.

In some embodiments, the audio data received by the microphone 112 inthe remote control 110, or by the one or more sensing devices 412 in theoverriding multimedia system 107′, may be transferred to the overridingmultimedia system 107′, which is then forwarded to the audio commandprocessing module 416 in the overriding multimedia system 107′ forprocessing and analysis. The audio command processing module 416 mayoperate to process and analyze the received audio data to recognize theuser 132's verbal command. The audio command processing module 416 maythen forward the verbal command to another component of the overridingmultimedia system 107′ for processing.

Overriding multimedia system 107′ may include one or more inputs and oneor more outputs coupled to the overriding multimedia device 402. Forexample, overriding multimedia device 402 may include one or more ofmultimedia input connectors connected to the overriding multimediadevice 402 and one or more respective media devices 106. The one or moreof multimedia input connectors may include, but are not limited to, afirst multimedia input connector 422 configured to connect (e.g., via afirst HDMI cable) to a media device 106 or one or more applications. Theone or more of multimedia input connectors may further include, but arenot limited to, a second multimedia input connector 423 configured toconnect (e.g., via a second HDMI cable) to the videoconferencingapplication 432, the alert application 434, and the one or more otherapplications 436. In some embodiments, the second multimedia inputconnector 423 may include one or more multimedia input connectors, suchas: one multimedia input connector connected to one of thevideoconferencing application 432, the alert application 434, and theone or more other applications 436: and another multimedia inputconnector connected to another of the videoconferencing application 432,the alert application 434, and the one or more other applications 436.Overriding multimedia system 107′ may further include a multimediaoutput connector 424 connected to the overriding multimedia device 402and a display device 108.

In some embodiments, the processing module 404 may be connected to theoverriding multimedia device 402 directly or, optionally, via anopto-isolator 414. For example, the processing module 404 may generate acontrol signal and transmit the control signal to the opto-isolator 414via a GPIO interface. Opto-isolator 414 may receive the control signal.In some embodiments, a control signal can be transmitted based on thereceived control signal, and transmit the control signal to theoverriding multimedia device 402 via a switch interface. In oneillustrative example, the control signal may be configured to instructthe overriding multimedia device 402 to perform a switching functionthat is substantially similar to the switching function that would havebeen performed had the user 132 actuated a physical switch (e.g.,pressed a physical button) connected to the overriding multimedia device402 to override the multimedia inputs.

Now referring to FIGS. 1, 2, 3, and 4 , in some embodiments, the user132 may interact with the media device 106, the overriding multimediasystem 107, the overriding multimedia system 107′, or a combinationthereof via, for example, the remote control 110. In streamingembodiments, the streaming module 202 may transmit the content to thedisplay device 108 in real time or near real time as it receives suchcontent from the content server(s) 120. In non-streaming embodiments,the media device 106 may store the content received from contentserver(s) 120 in storage/buffers 208 for later playback on displaydevice 108.

In one example, the user 132 may use the remote control 110 to interactwith the user interface module 206 of the media device 106 to selectcontent, such as a movie, TV show, music, book, application, game, etc.The streaming module 202 of the media device 106 may request theselected content from the content server(s) 120 over the network 118.The content server(s) 120 may transmit the requested content to thestreaming module 202. The media device 106 may transmit the receivedcontent to the display device 108 via the overriding multimedia system107 or 107′ for playback to the user 132.

In another example, the user 132 may use the remote control 110 tointeract with the user interface module 306 of the overriding multimediasystem 107 or the overriding multimedia system 107′ to select theoutputs of one or more media devices 106 to view on the display device108, such as when an incoming videoconference call is received by asecond media device (e.g., a videoconferencing device) or avideoconferencing application 432, respectively, when the user 132 iswatching a TV show on a first media device. The processing module 304 ofthe overriding multimedia system 107, or the processing module 404 ofthe overriding multimedia system 107′, may identify the request as arequest to perform a multimedia switching function, generate a controlsignal to instruct the overriding multimedia device 302 or theoverriding multimedia device 402 to switch its input from the firstmedia device to the second media device or the videoconferencingapplication 432, respectively, or a combination thereof (e.g., to bedisplayed by the display device 108 as a display screen overlay, a splitscreen, a mosaic, etc.). The processing module 304 or the processingmodule 404 may transmit the control signal to the overriding multimediadevice 302 directly or via the opto-isolator 314. In response, theoverriding multimedia device 302 or the overriding multimedia device 402may switch its input from the first media device to the second mediadevice or the videoconferencing application 432, respectively, or acombination thereof and transmit the corresponding multimedia signal tothe display device 108 for playback to the user 132.

Overriding Multimedia Systems

Referring to FIG. 1 , several media devices 106 may exist in each mediasystem 104. Accordingly, the media devices 106 may lend themselves tomultimedia switching embodiments. In some embodiments, the overridingmultimedia system 107 can operate to switch the audio and visual contentpresented to the user 132 by the display device 108 from a first mediadevice to a second media device or a combination of the first and secondmedia devices, such as when the user 132 receives a videoconference callwhile watching a TV show.

In some embodiments, as shown in FIG. 3 , overriding multimedia system107 may include a first multimedia input connector 322A configured toconnect to a first media device (e.g., a set-top box coupled to one ormore content servers 120) and receive a first multimedia signal (e.g.,content 122, metadata 124, or both) from the first media device. In someembodiments, overriding multimedia system 107 may include a secondmultimedia input connector 322B configured to connect to a second mediadevice (e.g., a videoconferencing device such as a smartphone) andreceive a second multimedia signal (e.g, a videoconferencing signal, analert signal) from the second media device. In some embodiments,overriding multimedia system 107 may include a multimedia outputconnector 324 configured to connect to a display device 108 and transmitthe first multimedia signal, the second multimedia signal, or acombination of the first multimedia signal and the second multimediasignal to the display device 108.

In some embodiments, overriding multimedia system 107 may furtherinclude an overriding multimedia device 302 that is electrically coupledto the first multimedia input connector 322A, the second multimediainput connector 322B, and the multimedia output connector 324. In someembodiments, the overriding multimedia device 302 may be configured togenerate, at a first time, a first conductive electrical path betweenthe first multimedia input connector 322A and the multimedia outputconnector 324. In some embodiments, the overriding multimedia device 302may be configured to receive (e.g., from processing module 304) amultimedia switching actuation signal (e.g., an HDMI CEC control signal)and, in response to a receipt of the multimedia switching actuationsignal, generate, at a second time later than the first time, a secondconductive electrical path between the second multimedia input connector322B and the multimedia output connector 324 to permit the second mediadevice to assume control (e.g., HDMI CEC control) over the output of theoverriding multimedia system 107. In some aspects, the multimediaswitching actuation signal may be configured to instruct the overridingmultimedia device 302 to perform a switching function as though the user132 had pressed a physical button connected to the overriding multimediadevice 302 to override the multimedia inputs.

In some embodiments, the first multimedia input connector 322A may be afirst HDMI input connector. In some embodiments, the second multimediainput connector 322B may be a second HDMI input connector. In someembodiments, the multimedia output connector 324 may be an HDMI outputconnector. In some embodiments, the overriding multimedia device 302 maybe an HDMI switching device (e.g., an HDMI switch). In some embodiments,the multimedia switching actuation signal may be an HDMI switchingactuation signal.

In some embodiments, overriding multimedia system 107 may furtherinclude one or more sensing devices 312 configured to detect sensor data(e.g., sensor data relating to, or potentially relating to, a multimediaswitching event). In some embodiments, the one or more sensing devices312 may include an audio sensing device, and the sensor data may includean audio signal. In at least one embodiment, sensor data can includeaudio data, video data, input data (e.g., user input via remote control,motion data, emergency alert data, phone call), and/or environmentaldata (e.g., proximity detection, fire detector, assistant device datasuch as an alarm or timer). In some embodiments, the audio signal mayinclude a voice command including a wake command (e.g., “Roku,” “Hey,”etc.) and an action command (e.g., “Call my dad,” “Answer call,” “Pickup the phone,” etc.) indicative of a request by the user 132 foroverriding multimedia system 107 to perform an action.

In some embodiments, overriding multimedia system 107 may furtherinclude storage/buffers 308 (e.g., a memory) configured to storepriority multimedia input data that includes: a first priority value forthe first multimedia signal, the first media device, or a combinationthereof; and a second priority value for the second multimedia signal,the second media device, or a combination thereof. In some embodiments,the processing module 304 may be configured to instruct the overridingmultimedia device 302 to select, as the input for multimedia outputconnector 324, the media device having the highest priority value. Forexample, the second priority value for the second media device may beconfigured to be less than the first priority value for the first mediadevice unless the second media device is receiving, making, playing, ordisplaying a video, audio, or multimedia call or alert. In oneillustrative example, at an initial time (e.g., such as when the user132 is watching a TV show via the first media device), the firstpriority value for the first media device may be about equal to 0.5 andthe second priority value for the second media device may be about equalto 0.0. Then, at a later time (e.g., such as when the user 132 makes orreceives a videoconference call, or receives an alert, via the secondmedia device), the first priority value for the first media device mayremain at about 0.5 and the processing module 304 may increase thesecond priority value for the second media device to about 1.0. Finally,at an even later time (e.g., such as when the videoconference call oralert is complete), the first priority value for the first media devicemay remain at about 0.5 and the processing module 304 may decrease thesecond priority value for the second media device back to about 0.0.

In some embodiments, overriding multimedia system 107 may furtherinclude processing module 304 (e.g., at least one processor) coupled tothe storage/buffers 308 and configured to determine, based on thepriority multimedia input data stored in the storage/buffers 308,whether the sensor data detected by the one or more sensing devices 312corresponds to a multimedia switching action. In one illustrativeexample, the sensor data may correspond to the multimedia switchingaction if the sensor data causes the first priority value and the secondpriority value to switch their priority ranking (e.g., if the sensordata causes the second priority value to increase above the firstpriority value, such as when initiating a videoconference call or alert;or if the sensor data causes the second priority value to decrease belowthe first priority value, such as when terminating the videoconferencecall or alert).

In response to a determination that the sensor data corresponds to themultimedia switching action, the processing module 304 is furtherconfigured to generate, at a third time between the first time and thesecond time, the multimedia switching actuation signal. The multimediaswitching actuation signal is configured to instruct the overridingmultimedia device 302 to switch an output of the multimedia outputconnector 324 from the first multimedia signal to the second multimediasignal. In some embodiments, the second multimedia signal may include acombination of the first multimedia signal and a third multimediasignal. The processing module 304 is further configured to transmit themultimedia switching actuation signal to the overriding multimediadevice 302 (e.g., via the opto-isolator 314).

In some embodiments, the first media device connected to the firstmultimedia input connector 322A may be a set-top box coupled (e.g., vianetwork 118) to one or more content servers 120, and the firstmultimedia signal may include content 122 and metadata 124 received fromthe one or more content servers 120. In some embodiments, the secondmedia device connected to the second multimedia input connector 322B maybe a videoconferencing device, and the second multimedia signal may be avideoconferencing signal (e.g., indicative of an incomingvideoconference call). In some embodiments, the processing module 304may be further configured to determine, based on the priority multimediainput data (e.g., in response to the sensor data representing a ringingsound corresponding to a maximum priority value), that the sensor datacorresponds to a videoconferencing initiation action. In someembodiments, the multimedia switching action may be, or include, thevideoconferencing initiation action.

In some embodiments, the multimedia switching actuation signal may beconfigured to instruct the overriding multimedia device 302 to switchthe output of the multimedia output connector 324 from the firstmultimedia signal to the second multimedia signal. In such embodiments,in response to the receipt of the multimedia switching actuation signal,the overriding multimedia device 302 may be further configured toterminate a display of the first multimedia signal. For example, inresponse to the receipt of the multimedia switching actuation signal,the overriding multimedia device 302 may be configured to terminate, ator before the second time, the first conductive electrical path betweenthe first multimedia input connector 322A and the multimedia outputconnector 324.

In some embodiments, the multimedia switching actuation signal may beconfigured to instruct the overriding multimedia device 302 to switchthe output of the multimedia output connector 324 from the firstmultimedia signal to a combination of the first multimedia signal andthe second multimedia signal. In such embodiments, the combination ofthe first multimedia signal and the second multimedia signal may includea multimedia overlay signal comprising the second multimedia signaloverlaid over the first multimedia signal.

In some embodiments, the one or more sensing devices 312 may include anaudio sensing device, and the sensor data may include an audio signal.In some embodiments, the audio signal may include a voice commandincluding a wake command (e.g., “Roku,” “Hey,” etc.) and an actioncommand (e.g., “Call my dad,” “Answer call,” “Pick up the phone,” etc.).In some embodiments, the processing module 304 may be further configuredto detect the wake command and, in response to a detection of the wakecommand, determine, based on the priority multimedia input data, thatthe action command corresponds to the multimedia switching action.

In some embodiments, the audio signal may include a ringing sound suchas a telephone ring. In some embodiments, the processing module 304 maybe further configured to detect the ringing sound and, in response to adetermination that the ringing sound corresponds to a videoconferencinginitiation action (and not, for example, a doorbell), determine, basedon the priority multimedia input data, that the ringing soundcorresponds to the multimedia switching action.

In some embodiments, the audio signal may include a beeping sound suchas a smoke alarm or an emergency notification (e.g., a WirelessEmergency Alert (WEA) from the U.S. Emergency Alert System; an America'sMissing: Broadcast Emergency Response (AMBER) Alert; a Silver Alert). Insome embodiments, the processing module 304 may be further configured todetect the beeping sound and, in response to a determination that thebeeping sound corresponds to an alert initiation action (and not, forexample, a siren in a TV show), determine, based on the prioritymultimedia input data, that the beeping sound corresponds to themultimedia switching action.

In some embodiments, the processing module 304 may be further configuredto classify the audio signal as a classified alert initiation action(e.g., to classify detected sounds or voice commands as alert initiationactions or videoconferencing initiation actions) using an audio signalclassifier machine learning model trained by a process comprising: (i)generating a probability value that the audio signal corresponds to analert initiation action; (ii) determining that the probability valuesatisfies an alert initiation action threshold value; and (iii)generating the classified alert initiation action based on thedetermining that the probability value satisfies an alert initiationaction threshold value. In some embodiments, in response to aclassification of the audio signal as the classified alert initiationaction, the processing module 304 may be further configured todetermine, based on the priority multimedia input data, that theclassified alert initiation action corresponds to the multimediaswitching action.

In some embodiments, the overriding multimedia system 107 may receive(e.g., from the second media device), an emergency signal (e.g., a WEA,AMBER, or Silver alert) and, in response, the processing module 304 maygenerate a multimedia switching actuation signal configured to instructthe overriding multimedia device 304 to switch its output to the secondmultimedia input connector 322B. If the display device 108 is turned offor in a sleep state, the processing module 304 may further instruct thedisplay device 108 to turn on or wake up, respectively, display thevideo included in the emergency signal, and increase its volume to amaximum volume level and play the audio included in the emergencysignal.

In some embodiments, as shown in FIG. 4 , overriding multimedia system107′ may include a first multimedia input connector 422 configured toconnect to a media device 106 (e.g., a set-top box coupled to one ormore content servers 120) and receive a first multimedia signal (e.g.,content 122, metadata 124, or both) from the media device 106. In someembodiments, overriding multimedia system 107′ may include a secondmultimedia input connector 423 configured to connect to avideoconferencing application 432, an alert application 434, one or moreother applications 436 (e.g., a photo album sharing application), or acombination thereof, via a multimedia communications path 450 (e.g., anHDMI cable), and receive a second multimedia signal (e.g, avideoconferencing signal, an alert signal) from the videoconferencingapplication 432, the alert application 434, or the one or more otherapplications 436. In some embodiments, overriding multimedia system 107′may include a multimedia output connector 424 configured to connect to adisplay device 108 and transmit the first multimedia signal, the secondmultimedia signal, or a combination of the first multimedia signal andthe second multimedia signal to the display device 108.

In some embodiments, overriding multimedia system 107′ may furtherinclude an overriding multimedia device 402 that is electrically coupledto the first multimedia input connector 422, the second multimedia inputconnector 423, and the multimedia output connector 424. In someembodiments, the overriding multimedia device 402 may be configured togenerate, at a first time, a first conductive electrical path betweenthe first multimedia input connector 422 and the multimedia outputconnector 424. In some embodiments, the overriding multimedia device 402may be configured to receive (e.g., from processing module 404) amultimedia switching actuation signal (e.g., an HDMI CEC control signal)and, in response to a receipt of the multimedia switching actuationsignal, generate, at a second time later than the first time, a secondconductive electrical path between the second multimedia input connector423 and the multimedia output connector 424 to permit thevideoconferencing application 432, the alert application 434, or the oneor more other applications 436 to assume control (e.g., HDMI CECcontrol) over the output of the overriding multimedia system 107′. Insome aspects, the multimedia switching actuation signal may beconfigured to instruct the overriding multimedia device 402 to perform aswitching function as though the user 132 had pressed a physical buttonconnected to the overriding multimedia device 402 to override themultimedia inputs.

In some embodiments, the first multimedia input connector 422 may be afirst HDMI input connector. In some embodiments, the second multimediainput connector 423 may be a second HDMI input connector. In someembodiments, the multimedia output connector 424 may be an HDMI outputconnector. In some embodiments, the overriding multimedia device 402 maybe an HDMI switching device (e.g., an HDMI switch). In some embodiments,the multimedia switching actuation signal may be an HDMI switchingactuation signal.

In some embodiments, overriding multimedia system 107′ may furtherinclude one or more sensing devices 412 configured to detect sensordata. In some embodiments, the one or more sensing devices 412 mayinclude an audio sensing device, and the sensor data may include anaudio signal. In some embodiments, the audio signal may include a voicecommand including a wake command and an action command indicative of arequest by the user 132 for overriding multimedia system 107′ to performan action.

In some embodiments, overriding multimedia system 107′ may furtherinclude storage/buffers 408 (e.g., a memory) configured to storepriority multimedia input data that includes a first priority value forthe media device 106 and a set of priority values for thevideoconferencing application 432, the alert application 434, the one ormore other applications 436, or a combination thereof.

In some embodiments, the processing module 404 may be configured toinstruct the overriding multimedia device 402 to select, as the inputfor multimedia output connector 424, the media device or applicationhaving the highest priority value. For example, the second priorityvalue for the videoconferencing application 432, the alert application434, or the one or more other applications 436 may be configured to beless than the first priority value for the media device 106 unless thevideoconferencing application 432, the alert application 434, or the oneor more other applications 436 is receiving, making, playing, ordisplaying a video, audio, or multimedia call or alert.

In one illustrative example, at an initial time (e.g., such as when theuser 132 is watching a TV show via the media device 106), the firstpriority value for the media device 106 may be about equal to 0.5 andthe second priority value for the videoconferencing application 432 maybe about equal to 0.0. Then, at a later time (e.g., such as when theuser 132 makes or receives a videoconference call via thevideoconferencing application 432), the first priority value for themedia device 106 may remain at about 0.5 and the processing module 404may increase the second priority value for the videoconferencingapplication 432 to about 1.0. Finally, at an even later time (e.g., suchas when the videoconference call or alert is complete), the firstpriority value for the media device 106 may remain at about 0.5 and theprocessing module 404 may decrease the second priority value for thevideoconferencing application 432 back to about 0.0.

In another illustrative example, at an initial time (e.g., such as whenthe user 132 is watching a TV show via the media device 106), the firstpriority value for the media device 106 may be about equal to 0.5 andthe second priority value for the alert application 434 may be aboutequal to 0.0. Then, at a later time (e.g., such as when the alertapplication 434 receives an non-emergency alert (e.g., an SMS textmessage, a calendar reminder, an event reminder, a medication reminder,a medication refill tracking notification, a medication ordering UI) oran emergency alert (e.g., a severe weather warning) via the alertapplication 434), the first priority value for the media device 106 mayremain at about 0.5 and the processing module 404 may increase thesecond priority value for the alert application 434 to about 1.0.Finally, at an even later time (e.g., such as when the alert is completeor after a timeout value has been reached), the first priority value forthe media device 106 may remain at about 0.5 and the processing module404 may decrease the second priority value for the alert application 434back to about 0.0.

In yet another illustrative example, at an initial time (e.g., such aswhen the user 132 is watching a TV show via the media device 106), thefirst priority value for the media device 106 may be about equal to 0.5,the second priority value for the videoconferencing application 432 maybe about equal to 0.1, and a third priority value for the alertapplication 434 may be equal to about 0.0. Then, at a later time (e.g.,such as when the user 132 makes or receives a videoconference call viathe videoconferencing application 432), the first priority value for themedia device 106 may remain at about 0.5, the third priority value forthe alert application 434 may remain at about 0.0, and the processingmodule 404 may increase the second priority value for thevideoconferencing application 432 to about 0.8. Then, at an even latertime (e.g., such as when the alert application 434 receives an emergencyalert via the alert application 434), the first priority value for themedia device 106 may remain at about 0.5, the second priority value forthe videoconferencing application 432 may remain at about 0.8, and theprocessing module 404 may increase the third priority value for thealert application 434 to about 1.0. Subsequently, at an even later time(e.g., such as when the alert is complete or after a timeout value hasbeen reached), the first priority value for the media device 106 mayremain at about 0.5, the second priority value for the videoconferencingapplication 432 may remain at about 0.8, and the processing module 404may decrease the third priority value for the alert application 434 backto about 0.0. Finally, at a still later time (e.g., such as when thevideoconference call is complete), the first priority value for themedia device 106 may remain at about 0.5, the third priority value forthe alert application 434 may remain at about 0.0, and the processingmodule 404 may decrease the second priority value for thevideoconferencing application 432 back to about 0.1.

In some embodiments, overriding multimedia system 107′ may furtherinclude processing module 404 (e.g., at least one processor) coupled tothe storage/buffers 408 and configured to determine, based on thepriority multimedia input data stored in the storage/buffers 408,whether the sensor data detected by the one or more sensing devices 412corresponds to a multimedia switching action. In one illustrativeexample, the sensor data may correspond to the multimedia switchingaction if the sensor data causes the first priority value and the secondpriority value to switch their priority ranking (e.g., if the sensordata causes the second priority value to increase above the firstpriority value, such as when initiating a videoconference call or alert;or if the sensor data causes the second priority value to decrease belowthe first priority value, such as when terminating the videoconferencecall or alert).

In response to a determination that the sensor data corresponds to themultimedia switching action, the processing module 404 is furtherconfigured to generate, at a third time between the first time and thesecond time, the multimedia switching actuation signal. The multimediaswitching actuation signal is configured to instruct the overridingmultimedia device 402 to switch an output of the multimedia outputconnector 424 from the first multimedia signal to the second multimediasignal. In some embodiments, the second multimedia signal may include acombination of the first multimedia signal and a third multimediasignal. The processing module 404 is further configured to transmit themultimedia switching actuation signal to the overriding multimediadevice 402 via a control communications path 440 connected to anoverride interface of the overriding multimedia device 402 (and,optionally, via the opto-isolator 414).

In some embodiments, the media device 106 connected to the firstmultimedia input connector 422 may be a set-top box coupled (e.g., vianetwork 118) to one or more content servers 120, and the firstmultimedia signal may include content 122 and metadata 124 received fromthe one or more content servers 120. In some embodiments, theapplication connected to the second multimedia input connector 423 maybe a videoconferencing application 432, and the second multimedia signalmay be a videoconferencing signal (e.g., indicative of an incomingvideoconference call). In some embodiments, the processing module 404may be further configured to determine, based on the priority multimediainput data, that the sensor data corresponds to a videoconferencinginitiation action. In some embodiments, the multimedia switching actionmay be, or include, the videoconferencing initiation action.

In some embodiments, the multimedia switching actuation signal may beconfigured to instruct the overriding multimedia device 402 to switchthe output of the multimedia output connector 424 from the firstmultimedia signal to the second multimedia signal. In such embodiments,in response to the receipt of the multimedia switching actuation signal,the overriding multimedia device 402 may be further configured toterminate, at or before the second time, a display of the firstmultimedia signal (e.g., by terminating the first conductive electricalpath between the first multimedia input connector 422 and the multimediaoutput connector 424).

In some embodiments, the multimedia switching actuation signal may beconfigured to instruct the overriding multimedia device 402 to switchthe output of the multimedia output connector 424 from the firstmultimedia signal to a combination of the first multimedia signal andthe second multimedia signal. In such embodiments, the combination ofthe first multimedia signal and the second multimedia signal may includea multimedia overlay signal comprising the second multimedia signaloverlaid over the first multimedia signal.

In some embodiments, the one or more sensing devices 412 may include anaudio sensing device, and the sensor data may include an audio signal.In some embodiments, the audio signal may include a voice commandincluding a wake command (e.g., “Roku,” “Hey,” etc.) and an actioncommand (e.g., “Call my dad,” “Answer call,” “Pick up the phone,” etc.).In some embodiments, the processing module 404 may be further configuredto detect the wake command and, in response to a detection of the wakecommand, determine, based on the priority multimedia input data, thatthe action command corresponds to the multimedia switching action.

In some embodiments, the audio signal may include a ringing sound suchas a telephone ring. In some embodiments, the processing module 404 maybe further configured to detect the ringing sound and, in response to adetermination that the ringing sound corresponds to a videoconferencinginitiation action (and not, for example, a doorbell), determine, basedon the priority multimedia input data, that the ringing soundcorresponds to the multimedia switching action.

In some embodiments, the audio signal may include a beeping sound suchas a smoke alarm or an emergency notification (e.g., a WEA, AMBER, orSilver alert). In some embodiments, the processing module 404 may befurther configured to detect the beeping sound and, in response to adetermination that the beeping sound corresponds to an alert initiationaction (and not, for example, a siren in a TV show), determine, based onthe priority multimedia input data, that the beeping sound correspondsto the multimedia switching action.

In some embodiments, the processing module 404 may be further configuredto classify the audio signal as a classified alert initiation action(e.g., to classify detected sounds or voice commands as alert initiationactions or videoconferencing initiation actions) using an audio signalclassifier machine learning model trained by a process comprising: (i)generating a probability value that the audio signal corresponds to analert initiation action; (ii) determining that the probability valuesatisfies an alert initiation action threshold value; and (iii)generating the classified alert initiation action based on thedetermining that the probability value satisfies an alert initiationaction threshold value. In some embodiments, in response to aclassification of the audio signal as the classified alert initiationaction, the processing module 404 may be further configured todetermine, based on the priority multimedia input data, that theclassified alert initiation action corresponds to the multimediaswitching action.

In some embodiments, the overriding multimedia system 107′ may receive(e.g., from the alert application 434; from an If This Then That (IFTTT)application included in the one or more other applications 436), anemergency signal (e.g., a WEA, AMBER, or Silver alert) and, in response,the processing module 304 may generate a multimedia switching actuationsignal configured to instruct the overriding multimedia device 404 toswitch its output to the second multimedia input connector 423. If thedisplay device 108 is turned off or in a sleep state, the processingmodule 404 may further instruct the display device 108 to turn on orwake up, respectively, display the video included in the emergencysignal, and increase its volume to a maximum volume level and play theaudio included in the emergency signal.

In one illustrative and non-limiting example, the user 132 may speak thevoice command “Hey, call my dad” while playing a video game on a videogame console connected to the user 132's respective display device 108through a respective overriding multimedia system 107′. In response, theoverriding multimedia system 107′ may perform a hardware switch of theHDMI channel connected to the respective multimedia output connector 424from the video game console to videoconferencing application 432.Thereby, the respective videoconferencing application 432 may gainhardware control of the HDMI CEC functionality of the respectiveoverriding multimedia system 107′. When the call is over, the respectivevideoconferencing application 432 relinquishes hardware control back tothe video game console.

Similarly, the user 132's father may receive an incoming videoconferencecall from the user 132 while watching a movie on a streaming deviceconnected to the user 132's father's respective display device 108through a respective overriding multimedia system 107′, and an incomingcall notification “Richard, your son is calling!” may be played,displayed, or both on the display device 108. The user 132's father mayspeak the voice command “Hello!” and, in response, the overridingmultimedia system 107′ may perform a hardware switch of the HDMI channelconnected to the respective multimedia output connector 424 from thestreaming device to videoconferencing application 432. Thereby, therespective videoconferencing application 432 may gain hardware controlof the HDMI CEC functionality of the respective overriding multimediasystem 107′. When the call is over, the respective videoconferencingapplication 432 relinquishes hardware control back to the streamingdevice.

FIG. 5 is a flowchart for a method 500 for multimedia switching,according to an embodiment. Method 500 can be performed by processinglogic that can include hardware (e.g., circuitry, dedicated logic,programmable logic, microcode, etc.), software (e.g., instructionsexecuting on a processing device), or a combination thereof. It is to beappreciated that not all steps may be needed to perform the disclosureprovided herein. Further, some of the steps may be performedsimultaneously, or in a different order than shown in FIG. 5 , as willbe understood by a person of ordinary skill in the art.

Method 500 shall be described with reference to FIGS. 1 and 3 (and, insome embodiments, with reference to FIG. 4 ). However, method 500 is notlimited to those example embodiments.

In 502, processing module 304 receives sensor data detected by one ormore sensing devices 312 and relating to a multimedia switching event,such as an incoming videoconference call or alert.

In 504, processing module 304 determines (e.g., based on prioritymultimedia input data stored in storage/buffers 308) that the sensordata corresponds to a multimedia switching action by determining thatthe sensor data has caused a first priority value for a first multimediasignal to decrease below a second priority value for a second multimediasignal. In one example, the first multimedia signal may be received bythe overriding multimedia device 302 from a first media device 106connected to the first multimedia input connector 322A of the overridingmultimedia device 302, and the second multimedia signal may be receivedby the overriding multimedia device 302 from a second media device 106connected to the second multimedia input connector 322B of theoverriding multimedia device 302. In another example, the firstmultimedia signal may be received by the overriding multimedia device402 from a media device 106 connected to the first multimedia inputconnector 422 of the overriding multimedia device 402, and the secondmultimedia signal may be received by the overriding multimedia device402 from an application (e.g., the videoconferencing application 432,the alert application 434, or the one or more other applications 436)connected to the second multimedia input connector 423 of the overridingmultimedia device 402. In yet another example, the first multimediasignal may be received by the overriding multimedia device 402 from afirst application (e.g., one of the videoconferencing application 432,the alert application 434, and the one or more other applications 436),and the second multimedia signal may be received by the overridingmultimedia device 402 from a second application (e.g., another of thevideoconferencing application 432, the alert application 434, and theone or more other applications 436).

In 506, in response to determining that the sensor data corresponds tothe multimedia switching action, processing module 304 generates amultimedia switching actuation signal that instructs an overridingmultimedia device 302 to switch an output of the overriding multimediadevice 302 (e.g., to a display device 108 connected to multimedia outputconnector 324) from the first multimedia signal to the second multimediasignal. In some embodiments, the second multimedia signal may includeany composition of signals, such as a combination of the firstmultimedia signal and a third multimedia signal (e.g., to be displayedby the display device 108 as a display screen overlay, a split screen, amosaic, etc.).

In 508, processing module 304 transmits the multimedia switchingactuation signal to the overriding multimedia device 302 to perform themultimedia switching.

Example Computer System

Various embodiments may be implemented, for example, using one or morewell-known computer systems, such as computer system 600 shown in FIG. 6. For example, the media device 106 may be implemented usingcombinations or sub-combinations of computer system 600. Also oralternatively, one or more computer systems 600 may be used, forexample, to implement any of the embodiments discussed herein, as wellas combinations and sub-combinations thereof.

Computer system 600 may include one or more processors (also calledcentral processing units, or CPUs), such as one or more processors 604.In some embodiments, one or more processors 604 may be connected to acommunications infrastructure 606 (e.g., a bus).

Computer system 600 may also include user input/output device(s) 603,such as monitors, keyboards, pointing devices, etc., which maycommunicate with communications infrastructure 606 through userinput/output interface(s) 602.

One or more of processors 604 may be a graphics processing unit (GPU).In an embodiment, a GPU may be a processor that is a specializedelectronic circuit designed to process mathematically intensiveapplications. The GPU may have a parallel structure that is efficientfor parallel processing of large blocks of data, such as mathematicallyintensive data common to computer graphics applications, images, videos,etc.

Computer system 600 may also include a main memory 608 (e.g., a primarymemory or storage device), such as random access memory (RAM). Mainmemory 608 may include one or more levels of cache. Main memory 608 mayhave stored therein control logic (i.e., computer software) and/or data.

Computer system 600 may also include one or more secondary storagedevices or memories such as secondary memory 610. Secondary memory 610may include, for example, a hard disk drive 612, a removable storagedrive 614 (e.g., a removable storage device), or both. Removable storagedrive 614 may be a floppy disk drive, a magnetic tape drive, a compactdisk drive, an optical storage device, tape backup device, and/or anyother storage device/drive.

Removable storage drive 614 may interact with a removable storage unit618. Removable storage unit 618 may include a computer usable orreadable storage device having stored thereon computer software (e.g.,control logic) and/or data. Removable storage unit 618 may be a floppydisk, magnetic tape, compact disk, DVD, optical storage disk, and/anyother computer data storage device. Removable storage drive 614 may readfrom and/or write to removable storage unit 618.

Secondary memory 610 may include other means, devices, components,instrumentalities or other approaches for allowing computer programsand/or other instructions and/or data to be accessed by computer system600. Such means, devices, components, instrumentalities or otherapproaches may include, for example, a removable storage unit 622 and aninterface 620. Examples of the removable storage unit 622 and theinterface 620 may include a program cartridge and cartridge interface(such as that found in video game devices), a removable memory chip(such as an EPROM or PROM) and associated socket, a memory stick and USBor other port, a memory card and associated memory card slot, and/or anyother removable storage unit and associated interface.

Computer system 600 may further include a communications interface 624(e.g., a network interface). Communications interface 624 may enablecomputer system 600 to communicate and interact with any combination ofexternal devices, external networks, external entities, etc.(individually and collectively referenced by reference number 628). Forexample, communications interface 624 may allow computer system 600 tocommunicate with external devices 628 (e.g., remote devices) overcommunications path 626, which may be wired and/or wireless (or acombination thereof), and which may include any combination of LANs,WANs, the Internet, etc. Control logic and/or data may be transmitted toand from computer system 600 via communications path 626.

Computer system 600 may also be any of a personal digital assistant(PDA), desktop workstation, laptop or notebook computer, netbook,tablet, smart phone, smart watch or other wearable, appliance, part ofthe Internet-of-Things, and/or embedded system, to name a fewnon-limiting examples, or any combination thereof.

Computer system 600 may be a client or server, accessing or hosting anyapplications and/or data through any delivery paradigm, including butnot limited to remote or distributed cloud computing solutions; local oron-premises software (“on-premise” cloud-based solutions); “as aservice” models (e.g., content as a service (CaaS), digital content as aservice (DCaaS), software as a service (SaaS), managed software as aservice (MSaaS), platform as a service (PaaS), desktop as a service(DaaS), framework as a service (FaaS), backend as a service (BaaS),mobile backend as a service (MBaaS), infrastructure as a service (IaaS),etc.); and/or a hybrid model including any combination of the foregoingexamples or other services or delivery paradigms.

Any applicable data structures, file formats, and schemas in computersystem 600 may be derived from standards including but not limited toJavaScript Object Notation (JSON), Extensible Markup Language (XML), YetAnother Markup Language (YAML), Extensible Hypertext Markup Language(XHTML), Wireless Markup Language (WML), MessagePack, XML User InterfaceLanguage (XUL), or any other functionally similar representations aloneor in combination. Alternatively, proprietary data structures, formatsor schemas may be used, either exclusively or in combination with knownor open standards.

In some embodiments, a tangible, non-transitory apparatus or article ofmanufacture including a tangible, non-transitory computer useable orreadable medium having control logic (software) stored thereon may alsobe referred to herein as a computer program product or program storagedevice. This includes, but is not limited to, computer system 600, mainmemory 608, secondary memory 610, removable storage unit 618, andremovable storage unit 622, as well as tangible articles of manufactureembodying any combination of the foregoing. Such control logic, whenexecuted by one or more data processing devices (such as computer system600 or processor(s) 604), may cause such data processing devices tooperate as described herein.

Based on the teachings contained in this disclosure, it will be apparentto persons skilled in the relevant art(s) how to make and useembodiments of this disclosure using data processing devices, computersystems and/or computer architectures other than that shown in FIG. 6 .In particular, embodiments can operate with software, hardware, and/oroperating system implementations other than those described herein.

CONCLUSION

It is to be appreciated that the Detailed Description section, and notany other section, is intended to be used to interpret the claims. Othersections can set forth one or more but not all example embodiments ascontemplated by the inventor(s), and thus, are not intended to limitthis disclosure or the appended claims in any way.

While this disclosure describes example embodiments for example fieldsand applications, it should be understood that the disclosure is notlimited thereto. Other embodiments and modifications thereto arepossible, and are within the scope and spirit of this disclosure. Forexample, and without limiting the generality of this paragraph,embodiments are not limited to the software, hardware, firmware, and/orentities illustrated in the figures and/or described herein. Further,embodiments (whether or not explicitly described herein) havesignificant utility to fields and applications beyond the examplesdescribed herein.

Embodiments have been described herein with the aid of functionalbuilding blocks illustrating the implementation of specified functionsand relationships thereof. The boundaries of these functional buildingblocks have been arbitrarily defined herein for the convenience of thedescription. Alternate boundaries can be defined as long as thespecified functions and relationships (or equivalents thereof) areappropriately performed. Also, alternative embodiments can performfunctional blocks, steps, operations, methods, etc. using orderingsdifferent than those described herein.

References herein to “one embodiment,” “an embodiment,” “an exampleembodiment,” or similar phrases, indicate that the embodiment describedmay include a particular feature, structure, or characteristic, butevery embodiment may not necessarily include the particular feature,structure, or characteristic. Moreover, such phrases are not necessarilyreferring to the same embodiment. Further, when a particular feature,structure, or characteristic is described in connection with anembodiment, it would be within the knowledge of persons skilled in therelevant art(s) to incorporate such feature, structure, orcharacteristic into other embodiments whether or not explicitlymentioned or described herein. Additionally, some embodiments can bedescribed using the expression “coupled” and “connected” along withtheir derivatives. These terms are not necessarily intended as synonymsfor each other. For example, some embodiments can be described using theterms “connected” and/or “coupled” to indicate that two or more elementsare in direct physical or electrical contact with each other. The term“coupled,” however, can also mean that two or more elements are not indirect contact with each other, but yet still co-operate or interactwith each other.

The breadth and scope of this disclosure should not be limited by any ofthe above-described example embodiments, but should be defined only inaccordance with the following claims and their equivalents.

1. An apparatus, comprising: a memory configured to store prioritymultimedia input data comprising a first priority value for a firstmultimedia signal and a second priority value for a second multimediasignal, wherein the first multimedia signal comprises content receivedfrom one or more content servers and the second multimedia signalcomprises a videoconferencing signal; and at least one processor coupledto the memory and configured to: receive sensor data detected by asensing device and relating to a multimedia switching event; determinethat the sensor data corresponds to a multimedia switching actioncomprising a videoconferencing initiation action based on a firstdetermination that the sensor data has caused the second priority valueto increase above the first priority value; and in response to a seconddetermination that the sensor data corresponds to the multimediaswitching action, generate a multimedia switching actuation signalconfigured to instruct an overriding multimedia device to switch anoutput of the overriding multimedia device from the first multimediasignal to the second multimedia signal, and transmit the multimediaswitching actuation signal to the overriding multimedia device.
 2. Theapparatus of claim 1, wherein the multimedia switching actuation signalis a High-Definition Multimedia Interface (HDMI) switching actuationsignal.
 3. (canceled)
 4. The apparatus of claim 1, wherein the secondmultimedia signal comprises a combination of the first multimedia signaland a third multimedia signal.
 5. The apparatus of claim 1, wherein thesensor data comprises an audio signal.
 6. The apparatus of claim 5,wherein: the audio signal comprises a voice command comprising a wakecommand and an action command; and the at least one processor is furtherconfigured to: detect the wake command; and in response to a detectionof the wake command, determine, based on the priority multimedia inputdata, that the action command corresponds to the multimedia switchingaction.
 7. The apparatus of claim 5, wherein: the at least one processoris further configured to: classify the audio signal as a classifiedalert initiation action using an audio signal classifier machinelearning model trained by a process comprising: generating a probabilityvalue that the audio signal corresponds to an alert initiation action,determining that the probability value satisfies an alert initiationaction threshold value, and generating the classified alert initiationaction based on the determining that the probability value satisfies analert initiation action threshold value; and in response to aclassification of the audio signal as the classified alert initiationaction, determine, based on the priority multimedia input data, that theclassified alert initiation action corresponds to the multimediaswitching action.
 8. The apparatus of claim 1, wherein the multimediaswitching actuation signal is further configured to instruct anoverriding multimedia device to terminate a display of the firstmultimedia signal.
 9. A non-transitory computer-readable medium havinginstructions stored thereon that, when executed by at least onecomputing device, cause the at least one computing device to performoperations comprising: receiving sensor data detected by a sensingdevice and relating to a multimedia switching event; determining thatthe sensor data corresponds to a multimedia switching action comprisinga videoconferencing initiation action by determining that the sensordata has caused a first priority value for a first multimedia signal todecrease below a second priority value for a second multimedia signal,wherein the first multimedia signal comprises content received from oneor more content servers and the second multimedia signal comprises avideoconferencing signal; and in response to the determining that thesensor data corresponds to the multimedia switching action, generating amultimedia switching actuation signal that instructs an overridingmultimedia device to switch an output of the overriding multimediadevice from the first multimedia signal to the second multimedia signal;and transmitting the multimedia switching actuation signal to theoverriding multimedia device.
 10. The non-transitory computer-readablemedium of claim 9, wherein the multimedia switching actuation signal isa High-Definition Multimedia Interface (HDMI) switching actuationsignal.
 11. (canceled)
 12. The non-transitory computer-readable mediumof claim 9, wherein the second multimedia signal comprises a combinationof the first multimedia signal and a third multimedia signal.
 13. Thenon-transitory computer-readable medium of claim 9, wherein: the sensordata comprises a voice command comprising a wake command and an actioncommand; and the operations further comprise: detecting the wakecommand; and in response to the detecting the wake command, determining,based on the priority multimedia input data, that the action commandcorresponds to the multimedia switching action.
 14. The non-transitorycomputer-readable medium of claim 9, wherein: the sensor data comprisesan audio signal; and the operations further comprise: classifying theaudio signal as a classified alert initiation action using an audiosignal classifier machine learning model trained by a processcomprising: generating a probability value that the audio signalcorresponds to an alert initiation action, determining that theprobability value satisfies an alert initiation action threshold value,and generating the classified alert initiation action based on thedetermining that the probability value satisfies an alert initiationaction threshold value; and in response to the classifying the audiosignal as the classified alert initiation action, determining, based onthe priority multimedia input data, that the classified alert initiationaction corresponds to the multimedia switching action.
 15. Acomputer-implemented method, comprising: receiving, by at least oneprocessor, sensor data detected by a sensing device and relating to amultimedia switching event; determining, by the at least one processor,that the sensor data corresponds to a multimedia switching actioncomprising a videoconferencing initiation action by determining that thesensor data has caused a first priority value for a first multimediasignal to decrease below a second priority value for a second multimediasignal, wherein the first multimedia signal comprises content receivedfrom one or more content servers and the second multimedia signalcomprises a videoconferencing signal; and in response to the determiningthat the sensor data corresponds to the multimedia switching action,generating, by the at least one processor, a multimedia switchingactuation signal that instructs an overriding multimedia device toswitch an output of the overriding multimedia device from the firstmultimedia signal to the second multimedia signal, and transmitting, bythe at least one processor, the multimedia switching actuation signal tothe overriding multimedia device.
 16. The computer-implemented method ofclaim 15, wherein the multimedia switching actuation signal is aHigh-Definition Multimedia Interface (HDMI) switching actuation signal.17. (canceled)
 18. The computer-implemented method of claim 15, whereinthe second multimedia signal comprises a combination of the firstmultimedia signal and a third multimedia signal.
 19. Thecomputer-implemented method of claim 15, wherein: the sensor datacomprises a voice command comprising a wake command and an actioncommand; and the operations further comprise: detecting, by the at leastone processor, the wake command; and in response to the detecting thewake command, determining, by the at least one processor and based onthe priority multimedia input data, that the action command correspondsto the multimedia switching action.
 20. The computer-implemented methodof claim 15, wherein: the sensor data comprises an audio signal; and theoperations further comprise: classifying the audio signal as aclassified alert initiation action using an audio signal classifiermachine learning model trained by a process comprising: generating aprobability value that the audio signal corresponds to an alertinitiation action, determining that the probability value satisfies analert initiation action threshold value, and generating the classifiedalert initiation action based on the determining that the probabilityvalue satisfies an alert initiation action threshold value; and inresponse to the classifying the audio signal as the classified alertinitiation action, determining, by the at least one processor and basedon the priority multimedia input data, that the classified alertinitiation action corresponds to the multimedia switching action.